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DESCRIPTION 

Method for Restoring Faded Photographs and Film 

Background of Invention 

[Paral] 1 . Field of the Invention 

[Para 2] The present invention relates to a color restoration method, and more specifically, 
to a method for restoring faded pictures or film. 

[Para 3] 2. Description of the Prior Art 

[Para 4] Almost everyone has old photographs of their parents, their grandparents, or of 
their childhood. When it comes to aging, photos fade in many different ways. In general, the 
aged photos often take a yellowish color, and the negatives also tend to have a reddish tone 
with time. As there are various considerable causes of fading, precious color photographic 
originals should be kept under safe conditions whenever possible. Keeping photographs 
and film in dark places with a low temperature and low moisture can help slow the effects of 

V 

aging, but cannot entirely prevent them. 

Summary of Invention 

[Para 5] It is therefore a primary objective of the claimed invention to provide a method for 
restoring aged photographs and film in order to solve the above-mentioned problems. 

[Para 6] According to the claimed invention, a method for restoring color of an image 

includes reading an original image and performing a white point balancing process on the 

original image. The method also includes segmenting the white point balanced image into a 

plurality of sub-images, sampling each sub-image to obtain color channel data for each 
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sub-image, selecting sub-images with a highest standard deviation of color channel data, 
and analyzing the selected sub-images to calculate a composite color channel mean for 
each color channel of the white point balanced image. For correcting the color of the image, 
the method also includes selecting a first color channel with a highest composite color 
channel mean, a second color channel with an intermediate composite color channel mean, 
and a third color channel with a lowest composite color channel mean, applying a power 
function on the first and third color channels of the white point balanced image to 
approximately equalize the color channel means of the first, second, and third color 
channels, and outputting a restored image. 

[Para 7] It is an advantage of the claimed invention that the means of all color channels are 
approximately equalized for balancing colors of the image, providing good color quality, 
and preserving good density of the image. 

[Para 8] These and other objectives of the claimed invention will no doubt become obvious 
to those of ordinary skill in the art after reading the following detailed description of the 
preferred embodiment, which is illustrated in the various figures and drawings. 

■ 

Brief Description of Drawings 
[Para 9] Fig.l is a flowchart summarizing the present invention method of restoring color 
of an image. 

[Para 10] Fig. 2 shows an original image to be restored. 

[Para 1 1] Fig. 3 is a histogram of color channel data for the present invention. 

[Para 1 2] Fig. 4 illustrates an algorithm for calculating the lower bound and upper bound for 

each color channel. 
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[Para 1 3] Fig. 5 illustrates the effects of a white point balancing process. 

[Para 14] Fig. 6 is a diagram of an image being segmented into sub-images according to the 

present invention. 

[Para 1 5] Fig. 7 is a flowchart illustrating the color correction method of the present 
invention. 

Detailed Description 

[Para 1 6] Please refer to Fig.l and Fig. 2. Fig.l is a flowchart summarizing the present 
invention method of restoring color of an image. Fig. 2 shows an original image A"^to be 
restored. In step 1 00 of the flowchart shown in Fig.l , the original image l° r '9 is read. The 
original image l ori 9 may be a photograph or film. First, an outside border of the original 

* 

image l on '9 is ignored in step 1 02 since the border may not contain any image data. 
Therefore, only an interior image / is used in the color restoration process of the present 
invention. Next, a white point balancing process is performed in step 104. The interior 
image / is then split into a plurality of sub-images in step 106. Sub-images with greatest 
color variance are selected in step 108, and are referred to as a region of interest. A mean 
for each color channel (such as red, green, and blue) is then calculated, and the means for 
respective color channels are compared with each other. The three color channels are sorted 
according to the value of their means. A proper power function is then determined in step 
1 1 0 for correcting the color channels with the highest and lowest means. In step 1 1 2, the 
power function is then applied to the entire image, thereby causing all three color channels 
to have an approximately equal mean and restoring the color quality of the original image 

■ 

/orig. 

■ 
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A detailed description of the present invention method will now be described. First of all, 
the size of the original image l° r, 9 is calculated, and l° r '9 has I£ ig rows and I° ri8 columns. 

Next, as shown in Fig. 2, a frame size FS is calculated around a border of the original image 
l<"ig t such that FS = [minCC* , if 8 ) / IFR] , where IFR is the Image-Frame Ratio. The interior 

i. 

section of the original image l° rl 9 is referred to as an interior image /, which is formed by 
removing FS pixels from each side of the image r rig . The interior image / has I m rows and 

/„ columns. Then a histogram of each channel of / is calculated. The histogram' H R for the 

R channel, for example, is computed such that H R = {h i ) , where 

K =#({p\p- i, pis the pixel value in R channel}), and #()is the counting measure from set to5R(or 

1). If is too large, sample pixels can be taken from the interior image / instead. A 

histogram will be calculated for each channel R, G, and B. Since the histogram H is 
computed in the same way for each channel, it will only be explained once. 

Please refer to Fig. 3. Fig. 3 is a histogram of color channel data for the present invention. 
The histogram in Fig. 3 shows the number of pixels in the image I having a certain color 
value. As an example, the histogram shown in Fig. 3 assumes 8-bit color is used, and the 
color values can range from 0 to 255. Next, a lower bound IL and an upper bound IU are 
calculated for the interior image I. The lower and upper bounds IL and IU are calculated 
according to a predetermined fraction cof pixels in the image I (for example, the fraction c 

n 

may have a value of 0.05). For each channel, = sup {« | £ /*,. <clj n ) and 

1=0 

n 

IU = inf{Az|J]/j ( . >{\-c)IJ n }, where cis a fixed number between 0 and 1, and hi is the number 

(=0 

of pixels for a given color value. 
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[Para 1 7] Please refer to Fig. 4. Fig. 4 illustrates an algorithm for calculating the lower bound 
IL and upper bound IU for each color channel. The algorithm begins in step 140, and 
variables are initialized in step 142. The variable HSum is used to calculate a total sum of 
pixels in the histogram, and i is a counter variable for indicating the color value. In steps 
144 and 146, the i counter is incremented and the value of h(i) is added to HSum. According 
to step 1 48, steps 1 44 and 1 46 are repeated until HSum is greater than or equal to c*l m *ln. 
Once HSum is greater than or equal to c*l m *ln, the value of the lower bound IL is set equal to 
the current value of i in step 1 50. To calculate the upper bound IU, the i counter is 
incremented and the value of h(i) is added to HSum in steps 1 52 and 1 54. According to step 
1 56, steps 1 52 and 1 54 are repeated until HSum is greater than or equal to (l-c)*l m *ln. 
Once HSum is greater than or equal to (l-c)*l m *ln, the value of the upper bound IU is set 
equal to the current value of i-1 in step 1 58. Once the lower bound IL and the upper bound 
IU are calculated, the algorithm is ended in step 160. 



After the lower bound IL and the upper bound IU have been calculated, a white point 
balancing process is performed. In this process, the color value of each pixel pix of the 



considered channel will be replaced by: pix = 



OU if pix > IU 

OL + (OU - OL)(pix - IL) /(IU - IL) if IL < pix < IU 
OL if pix<IL 



The effects of the white point balancing process are illustrated in Fig. 5. The output 

lower bound OL and output upper bound OU are defined in terms of the input lower bound 

IL and the input upper bound IU. After the white point balancing process has been 

performed, the image / is segmented into mn sub-images. Each of the sub-images is 
referred to as sub-image I ijt where 0£i<m and 0<j<n. Please refer to Fig. 6. Fig. 6 is a 

diagram of image I being segmented into sub-images /„ according to the present invention. 
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The center of each sub-image I y has a centerindicated by point 20 on Fig. 6, which has the 
coordinates (idx m ,idx n ) . A top-left corner of each sub-image is located at the point 
{idx m - radius m Jdx n - radius J and a lower-right corner is located at the point 

(idx m + radius m ,idx n + radius J , where idx m =[{i-\)I m I m] and idx n -\)I n / n]. 

Please refer to Fig. 7. Fig. 7 is a flowchart illustrating the color correction method of the 
present invention. After generating the sub-images , a histogram H g calculated for 

each generated for each sub-image I y . Utilizing the histograms H & , a mean M i} and 

standard deviation S t are calculated. Alternatively, the means M i} and standard deviations 

Sfj can also be calculated directly from Once the standard deviations S g are calculated, 

the standard deviations S 0 are rearranged as a decreasing sequence S k , thereby forming set 

4 

T = {(i,j,k)\S k+l <S k ,S i =S iJ for alii, j} . Then, a cutoff point p is defined as p = [cl4(T)] with 
0<cl<l. The elements in the decreasing sequence S k greater than the cutoff point p are 
then selected to be in a set ROI = {I iJ \(i,j,k)inT,S k > p) . That is, the set ROI contains the 
higher standard deviations S iJt and is referred to as the region of interest in step 1 70 of the 
flowchart in Fig. 7. Using the set ROI, the mean of {I y {Iy in ROI} is computed for each 
channel, which will respectively be referred to as R m ,G m ,B m for the red, green, and blue 
channels (step 1 72). Next, the means R m ,G m ,B m will be sorted in increasing order in step 
174, and labeled as values (s,m,l), without loss of generality, we assume s = R m ,m = G m ,l-B m . 
In step 1 76, exponents g s ,g m , and g, corresponding to the labels s, m, and / are all 

+ 

initialized to a value of 1. For the R channel, the mean R m \s less than the mean G m . To 
equalize the means R m and G m , a power function f(x) = x UCs is applied to the corresponding 
ROI set of the R channel in step 1 78, where g s >l. The value of g s is repeatedly incremented 

by a small fixed amount k (such as 0.1 or less) in step 182 until the relationship 
abs(mean(f (1 .. in ROI) -m)< tolerance is satisfied in step 180. Once this relationship is satisfied, 
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the means R m and G m are approximately equalized. In steps, 184, 186, and 188, the same 
process is repeated for equalizing means B m and G m . The only difference is the value of g, 

> 

is repeatedly decremented by the small fixed amount k so that £,<1. After these values of 
g s and g, have been calculated using the set ROi, the power function f(x) = x UG is applied to 

the R, C, and B color channels of the entire image I for equalizing the R, C, and B color 
channels. 

[Para 1 8] In contrast to the prior art, the present invention method equalizes color channel 
levels to provide good color quality and preserve good density of the image. If a photograph 
is being restored, the corrected image will no longer have a yellowish tint. If film is being 
restored, the corrected image will no longer have a reddish tint. Therefore, the present 
invention method provides a way to restore aged photographs and film through a simple 
mathematical algorithm. 

[Para 1 9] Those skilled in the art will readily observe that numerous modifications and 

* 

alterations of the device may be made while retaining the teachings of the invention. 
Accordingly, the above disclosure should be construed as limited only by the metes and 
bounds of the appended claims. 
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